Extract the information from big data with randomly distributed noise
نویسندگان
چکیده
Abstract In this manuscript, a purely data-driven statistical regularization method is proposed for extracting the information from big data with randomly distributed noise. Since variance of noise may be large, can regarded as general preprocessing in ill-posed problems, which able to overcome difficulty that traditional unable solve, and has superior advantage computing efficiency. The unique solvability proved, number conditions are given characterize solution. parameter strategy discussed, rigorous upper bound estimation confidence interval error L 2 L^{2} norm established. Some numerical examples provided illustrate appropriateness effectiveness method.
منابع مشابه
Big Data Quality: From Content to Context
Over the last 20 years, and particularly with the advent of Big Data and analytics, the research area around Data and Information Quality (DIQ) is still a fast growing research area. There are many views and streams in DIQ research, generally aiming at improving the effectiveness of decision making in organizations. Although there are a lot of researches aimed at clarifying the role of BIG data...
متن کاملReal-Time Information Extraction from Big Data
We are drowning under the 3 Vs (volume, velocity and variety) of big data. Real-time information extraction from big data, at global as well as local levels, is critical for making rapid decisions in many important DoD scenarios. However, such real-time information from big data is enormously complex and extremely challenging. We argue that data movement is of crucial importance in big data ana...
متن کاملFrom big data to important information
Advances in science are being sought in newly available opportunities to collect massive quantities of data about complex systems. While key advances are being made in detailed mapping of systems, how to relate this data to solving many of the challenges facing humanity is unclear. The questions we often wish to address require identifying the impact of interventions on the system and that impa...
متن کاملBig Data Efficiency, Information Waste and Lean Big Data Management: Lessons from the Smart Grid Implementation
Big data has become a popular buzzword today with the underlying assumption that bigger data is better. However, by its nature, big data comes with many challenges and environmental costs. In contrast to other research that has examined the benefits and costs of big data independently, our research-in-progress provides an integrated perspective. Theoretically, we draw on the perspective of lean...
متن کاملNoise Induced Pattern Switching in Randomly Distributed Delayed Swarm Patterns
We study the effects of noise on the dynamics of a system of coupled self-propelling particles in the case where the coupling is time-delayed, and the delays are discrete and randomly generated. Previous work has demonstrated that the stability of a class of emerging patterns depends upon all moments of the time delay distribution, and predicts their bifurcation parameter ranges. Near the bifur...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Inverse and Ill-posed Problems
سال: 2021
ISSN: ['0928-0219', '1569-3945']
DOI: https://doi.org/10.1515/jiip-2021-0016